DOCUMENT RESUME 



/ ED 217 041 

AUTHOR 
TITLE 

INSTITUTION 
. SPONS AGENCY 



SP 020 372 



PUB DATE 
NOTE 



EDRS PRICE 
DESCRIPTORS 



Gennari, Patricia A..; And Others 
The. Data-Based Staff Development Program: Design, 
Implementation, and Effects. .„ - 
Pittsburgh Univ., Pa. .Learning Research and 
Development*' Center. 

National Inst, of Education (ED), Washington, DC; 
Office of Elementary and Secondary Education (ED), 
Washington, DC; Office of Special Education and 
Rehabilitative Services (ED), Washington, DC. 
Mar 82 

41p. ; Pap^r presented at the Annual Meeting of the 
American Educational Research Association (New York, 
NY, March, 1982). 

5iF01/PC02 Plus Postage.' 
/Classroom Techniques; Educational Innovation; 
" Elementary Education; Evaluation Criteria; . 

. * -individualized Instruction f Inservice Teacher 

Education; Needs Assessment; ^Program Development; 
♦Program Effectiveness; *Program Implementation; 
♦School Personnel; *Staff Development. 

ABSTRACT * 

The 'Data-Based Staff Development Program is an, 
integral feature of the Adaptive Learning Environments Model (ALEM) , 
an educational program developed to provide basic skills learning 
experiences that are adaptive to the individual learning needs of 
students. The Data-Based Staff Development Program was designed to 

\ assist school personnel responsible for implementing jthe AUEM^iji 
systematically incorporating relevant data oh the degree of program 

\ implementation and students' learhing progress in analyses of their 
staff development needs^ The goal is to provide a self-monitoring . 
tool that herps school personnel befiome A , increasingly more independent 
ito establishing and maintaining* a high degree of ALEM implementation. 
During the 1980-81 school year, a pilot investigation of the 
effectiveness of this program in improving classroom implementation 
of ihe ALEM was conducted in ten elementary schools. Data were 
obtained through the use of three measures: (1) instruments measuring 
degree of program implementation; (2)* school district staff 
development plans; and (3) monthly training^ logs kept by the schools' 
education specialists. The data were analyzed to investigate the 

. relationship between staff .development plans and program, 
implementation needs as suggested in the degree of implementation 

^scores for individual teachers. Preliminary evidence from the study 
supports the effectiveness of the program; more detailed studies in 
the future will be /needed to confirm this finding. Tables illustrate^ 
the critical factors used"in analyses and the results of the study. 
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Abstract 

. - - * - _ * 

This paper describes the rationale and design of the Data-Based 

Staff Development frograifi, aimed at training school staff to implemeAt 

an innovative program for providing school learning experiences that are 

adaptive to individual student differences • The paper also summarizes- a 

pil^t study of the effectiveness of the Data-Based' Staff Development 

Program in improving implementation of the innovative" program in a, 

• * * 

variety of school .settings. .Data from the study provide preliminary 

evidence of the effectiveness of using a data-based approach to staff 



development, as well as suggest future lines of work in this ar<?a# 



/The* Data-Based;, Staff Development^Progr&m: 
Design, Implementation, and Effects 



Patricia A. Gennari, Nicholas Tqmich, and Mary Zajac 

Learning Research and Development Center 
University of Pittsburgh * \ 



The need to provide school staff *with the educational opportunities 
required for continuing professional development has received ^increased 
attention in recent years-; for at least two reasons. First, many school 
improvement v efforts that require new or upgraded skills on the part of 

. , \ • - - 

- .Staff # \ members have been undertaken. Second, as the result or 
^ legislative mandates such, ap those calling for desegregated schools and 
the mainstreaming of exceptional children in regular classrooms, schools 
are faced with the -~ task of retraining staff members to take on the 
challenge of providing quality educational experiences % for an- 
increasingly diverse population* ^ 

While the need for staff development programs is* -recognized — among 
*' both researcher^ and practitioners, systematic development of such 
programs as an integral part of improvement efforts is scattered, "at 
best,* It is in this * context that work on the Data-Based Staff 
Development Program was initiated . \ . 

• \ 

The purposes of this paper are (a) to describe the Data-Based^ Staff 



Development Program, designed to train school staff to implement the 
programmatic and personnel role changes required to, effectively 
-jeMJ&blish. - and maintain an inno v ativ e program aimed at providing school 
learning experienced that are adaptive to student differences; <anq (b) 
to present, and dis\uss the implications of, findings from a study 
conducted to investigate the effectiveness of the Data-Based Staff 
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Development Program . in ^ improving # classroom implementation of the 

innovative program. Specifically, the paper \ includes three "sections. 

The first * consists of an overview of the Data-Based Staff Development 

Propria. This overview is followed by a description of a pilot, study^ 

aimed at investigating the program '.s effectiveness. A summary of study 



findings and a discyssion .pf their implications 0 for future^ work are 

• ' / e 

presented in the final section of the paper. * 

- _ ^ ■ 

Overview o£ the Data-Based , 
^ - Staff Development Program 

\ In this overview, the rationale for the Data-Based Staff 
Development, Program is discussed ^first. The design of the program is 
then described in" some detail. • 



Rationale i ^ ' 

The Data-Based Staff Development Program was developed based on two 
major premises 3 The first is that the establishment and maintenance of 



innovative school programs require not only detailed specification and 
-understanding of t£e programs' design and operating features, but also 
the conduct of staff development activities to promote understanding of 
the programs and to support their day-to-day implementation in 
classrooms (Wang, 1980b). Second, tjie staff development programs that* 
are designed must have certain characteristics. As an example, staff 
development programs must be adaptive; that is, they must focus on the 



needs of individual staff members. Teachers (and other professional and 

» 

paraprof essional staf f ) ^learn in different ways • More impor tantly , they 

' - _ * " - *o \ \ 

come to the classroom at "different stages, somes more advanced than 

•> 

others* Staff development programs must be tailored to the identified 

, " ' 5 . : 

- •" ■ - ^ ; , , * > ^— 



strengths and weaknesses of individuals, not of the group at^, large. In 
addition to being adaptive, staff development programs must focus on the 

r . 

day-to-day implementation problems that teachers face <and must be 
conf in^ous ^ in natura, assisting 4 teachers ever^ Stejp o£ the way/ 
In-service programs that occur every two to three months are inadequate.. 
Teachers! need frequent contact and" continuous support in their* efforts 
to solvq both short- and long-range problems*. 



These essential ^characteristics of effective staff development 
programs are not unique, ^hey have^ been identified in a number of 
research and development efforts in the area of staff development (e.g., 
Cru'ickshank, Lorish, & Thompson, 1979; Griffin, 1979; tfcL&ughlin & 
March, 1979; .McNergney, 1980; Miller & Wolf, 1979; Perry * 1980; 

\ 

Zigarai^, Amory, & Zigarmi, 1979); . 

The Data-Based Staff Development Program is an integral feature of 

the Adaptive Learning Environments Model (ALEM) , an educational program 

* * * « 

developed at the Learning Research and Development Center (LRDC) of the 
University o£ Pit tsb&rgh. to, provide school learning experiences that are 

adaptive to the individual learning needs of students (Wang, 1980a, 

\ 

1980b). The Data-Based Staff Development Program is designed, to assist 

those school personnel responsible for implementing the ALEM in s 

i 

systematically incorporating relevant data on the degree of program 
implementation aftd students' learning progress in analyses of their 
staff development needs. The goal is to provide a self-monitoring tool 
that helps school personnel become increasingly more independent in 
establishing and maintaining a high degree of program implementation. 



Among the expected outcomes of the Data-Based Staff Development Program 
are increased self-$uf f iciency in schools' monitoring .of their program, 
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implementation and, | subsequently, institutionalization of educational 
innovation, like the . ALEM, at?-^ local sites In order to provide 



background information on the "Data-Based Staff Development Program, the 
ALEM. is described briefly below* * a 



The overall goaXf^oi the ^A^EM /£s^ to create school learning 

J. * 
environments in v^hich each student can acquire b&sic ^academic skills 



while becoming "increasingly moife confidant in his or her ability to 



learn and to, cope with the social and physical surroundings of the 

i ' * « * 

i • . . . . - I 



1 

classroom (Wang, ^1980a). *TWs goal is accomplished by \ combining- thpj 
advantages of both a highly structured programming component, which 
^includes a* built-in, diagnostic-prescriptive proceduire^f or the 

' • • • * 1 ^* v *^ 

development of skills in basic academic subject areas (e.vg., readin^and 
c matt|), and a^more" open-ended, exploratory learning component, which 
1 includes a. variety 'of problem-solving and student-initiated activities 
for social and personal development, ^jor* expected outcomes of the 
ALEM for students are effective use of school time, motivation to spend 

the time "required to master tba basic academic skills, and development 

fc " ■! ft . • M. 

or increased competence in independently managing learning and the 

school learning environment. At the same s time, teachers functioning 

under the ALEM are expected to be able 4 to spend increased ampunts of 

■ 1 ' 

time providing instruction rather than managing students. 

«. - \ 

» % 

Thd underlying assumption of , the ALEM s design is that the 
implementation of innovative educational programs requires some 
fundamental changed in the nature and structure of, schools' curricular 
materials and instructional procedures, their organizational and staff 



support systems!, their teaching and learning processes, and the ^oles of 
teachers and students. Because of the ALEM's unique program design and 



% , - * • ' - 

the fundamental changes in teacher and student roles required to 

1 1 1 

effectively establish, >.and maintain a i high -degree' of program 

implementation, the development- of a staff development' program tTiat 

provides school personnel with V/ appropriatre technical assistance has been 

"a major R&D effort iri the'~design^and field testing of the ALEM. 




Design— 



. The ALEM's Data-Based \ Staff Development Program includes- three 
major training levels, a set of measures for assessing the degree of 
program implementation, and systematic and adaptive staff development 
plans. 

Training levels . The Data-Based Staff Development Program 
incorporates three levels of training, ranging from initial awareness 
training to ongoing in-service training. Figure 1 shows the levels and 
sequential steps of the Data-Based Staff Development Program. As 
outlined in Figure 1, level I is designed to provide basic working 



knowledge of the carricuLar_content and procedures incorporated in the 
t ALEM. In Level .II, morfe intensive training is .provided [ iiv specific 
staff functions. Level III is a clinical training component tailored to 
the needs of individual staff. Training at ■ Level III is ongoing, 
in-service training designed to help school staff continually improve 
and upgrade their classroom implementation. It is primarily atj the 
third, level "of the Data-Based Staff Development Program that the 
iterative process of assessment, feedback, planning, and *tr^ining occurs 
(Wang, Note 1). ■ 



Insert Figure 1 about here 
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1. Level I: Basic training . ? Training ^at — Level — r ~~iST aimed at 

iJrrr: - v -==-- - ; ■ * . , 

providing an overview of 'the ALEM and working knowledge about the 

* ■» > 

implementation" requirements o£ the various -program components* The 

'basic training level focuses on ihree matjor topic areas* They are (a) 

■ * * «s « » 

* * * ■ 

• * - 

t,he rationale and design of the ALEM * and relevant program evaluation- 

results; ^ (b) a n overview~of the various program components; and (c) 

; ' ' \ 

the knowledge and skills required for program implementation ^(e.g., 

■* 

information on the content covered in each 4 of the basic skills and 
exploratory learning areas; the - procedures for diagnostic testing, 
prescription writing, and record keeping; the design of the classroom. 

' • - " . \ •• 

environment; the management and display of learning materials; 'and* the 

procedures for ; self-scheduling)* Level I staff development activities 

generally are scheduled as pre-implementation sessions* They are 

designed for , all relevant administrative personnel (fronf central 
* - 

administrative staff to those at the building level) , as well as for 

instructional and other support personnel whose duties' af fleet the 
* 

\ 

ijnplegLe.n^ services^ to 

— \ - i 

students in ALEM classrooms. Staff development work at the basic 

•* * * 

training level generally requires two or three days. * 

I A * 

2. Level II : Individualized training . Staff development 
activities at the individualized training^lgyel are -designed to provide 

-In-depth training that is specific to each staff member's functions, 

> 

based on 'analyses of site-specific program implementation needs. 

. « * ** 

Essentially, training at *his level 1 is designed to provide 
differentiated staff development activities prior vto program' 
implementation. -Specific training activities are designed according j to 
an analysis of the functions to be carried out in the ^implementation of 
the ^LEM and the assignment of those functions to the various (district 



personnel' whose present . responsibilities might not include the 
functions. / ' • 

As indicated in Figure 1, individualized training. is designed to*be 
provide^ .^tp four basic t£Res of personnel: ; classroom teachers, 
ussroom aide?, education specialists, and .family specialists. The 
amount of time required for Level II training varies from site to site * 
(depending <Jft individual schools' unique constraints and their staff's 
understanding of A their? roles and. functions), and a detailed p^an for 
each site/ s pfogram implementation is developed • Individualized 
training sessions, which last two 'or three days, generally are scheduled 

immediately 'after Lwel I basic, training sessions. Experience has shown 

» * * 

that the total staff development work c at „ Levels I and II can be 
completed in a week-long workshop prior to the opening of school. 

3. Level III ; In-service training . Level III, the in-service 

training component of the Data-Based Staff Development Program, is thk % 

.culmination of an interactive process of program assessment, feedback, 

9 planning, and ongoiiTg^tVf redevelopment wofk. Essentially, it provides 

the technical support required to establish and maintain a high .degree" ~ 

'of program implementation 'at school sites-. The in-service training 

component is designed to, be adaptive to the training needs and expertise' 

of individual" staff •; As a result, the type and frequency of 3ln-service 

training -sessions vary for 4 * different sites and staf-f^ They range from 

short meetings (during teacher preparation times) to half-day workshops. 

% . 

% * 

1 As shown in Figure 1 , there, are two types of Level • III training 

sessions: staff planning sessions' and sessions for feedback and 

c 

training. Staff plannirig. sessions are designed to develop plans to. 
ac^mpl^h-^etetft^ objectives and to determine 

10 ' 



/ Page 8 



'topics* for staff feedback and training. Staff planning J!k based .on 

information fr^a classroom ' observations, dkta on students' learning 

•\ \ % 

progress', and feedback from family members* Sessions for staff 'feedback 

and straining 'are hel.d throughout the school year, \"The£ provide- 

opportunities - to discuss critical issues relatgd?^ to .program 

implementation/ particularly in" ■ terms , of program 'refinement ~ and 

improvement in the degree of progranf implementation. Feedback^ and 

r > 
training sessions are scheduled on a regular bas*is, .according to staff 

' " ' . . < - « / . * . * 

members' needa and interests* They usually take place during regular 
staff planning times and/or during schools' scheduled team meetings and^" 
in-service training times, i ■ • 

. \ > 

Degree of program implementation measures . A critical prerequisite 
for the development of a system for establishing and maintaining a high 
degree of implementation of an innovative educational 'program is ' the 
availability of information on r.he extent to which the program's design 
actually is implemented. The development of degree" o£ implementatibn ^ 
measures to assess the presence- and absence of the ALEM's critical 
design features began with the identification of 12 critical dimensions 
of the program. These dimensions were^ identified through an analysis of 
the program's structural and action domains. The structural domain 
*ref ers * to • those aspects of- the program's design tjhat^are required t& 
establish the conditions sunder which program activities can be' :> 

4 - 

implemented effectively. The action, domain consists of those roles and - 

behaviors of the instructional staff and students* that are required for 

effective functioning under the *ALEM. Subsequent to the identification 

of the critical dimensions, performance indicators for each, dimension 

♦ 

wer§ identified (Wang, Note '2). Ninety-six performance indicators for 
assessing the presenqe and absence of the 12 critical dimensions were 

-. v ii 

■fa 
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identified and grouped *lnto a battery of six degree of implementation 

; - ' 

instruments'. ^« 

Two of the degree of implementation instruments are designed for 
observing .dynamic aspects of program implementation — the Observation 

-> ■ • • 

Checklist for Teacher Traveling Behavio" and* t>he Observation Checklist 
for Student Classroom Behavior . These checklists are' administered 
during clas,? time', while- students and teachers engage in *the 
instructional-learning process ♦ Two instruments focus on non-dynamic 



ob'servables — the Checklist to\ Physical Design of the Classroom and the 

\ 

Chefcklist for Classroom Records . These instruments are administered 
before or after regular class time, when students and teachers are not 
present in the classroom. The final two instruments are interview' 
questionnaires designed to. ej-icit comments from students and teachers on 

^variqus aspects of program 5 implementation' — the Student Interview and the 

* • • „ i 

Teacher interview . ' The Teacher Interview Is administered before or 

\ . 
after class time, and the S tudent Interview is administered during class 

time. (Infprmation on-the validation of the degree' of implementation 

instruments is found in Strom and Wang [Note 3])* . 

► * ** 

* * * - 

Thfe degree of implementation instruments are' used by school 
personnel .on a regular basis to collect implementation 'information for 
staff development purposes (i.e., the in-servicp training Component of 
the Data-Baspd Staff Development Prpgram). School personnel are 
encouraged to uSe the instruments, ds needed, to monitor the degree of 
programTimplementation in their classrooms. The 3ata also are collected 
at least ^ thr^e-^ tljpes during the j school year (usually in October; 



February,/ and April)' for program evaluation purposes*. It generally 
takes about? two hours per classroom to complete /administer) a H s * x 

'*"*•• A. * 

1 « " tl * * 

degree of * implementation instruments. 



\ Page 10 



^ A computer program was developed to analyze and report? degree of 
implementation data in a form * tfcat can be used by site personnel to 
design and. monitor site-specific staff development plans aimed at 
improving program implementation ( Schmid hammer ,~Note 4). Figure 2 is an 
^xaniple of a computer printout of an analysis of the degree of 



implementation data, 

\ - • • 




Insert Figure 2 about here 



As shown in the figure, the data are analyzed in four different 
levels or .units:' site, school, grade level, and class (teacher). The 
mean scores -for the cfltical dimensions of the ALEM are" reported in 12 
separate columns. The names and acronyms for the dimensions, as they 
are .listed in the left-hand corner of the printout, are "arranging space 
and' facilities 11 (AS&F) , "creating ..and maintaining instructional 

- * ' & . , • 

materials" (CMIM), "establishing and communicating- rules and procedures" 
(ECRP) , -."managing aides" (MA).,„ "testing" (TEST) , "record keeping" 
CRCRD), "monitoring and diagnosing" (M&D) , "prescribing" (PRES), 
"traveling" (TRAV) , "instructing" (INST), "motivating"^ (MOTI); and 
"student planning" (SP). The number in parentheses under the acronym 
for each dimension indicates the^ total number of items (performance 

indicators) included. in the monitoring instruments to assess the degree 

• „\ . / * . * i 

of implementation ? of Stoat, dimension. For example, in "creating and 



^ "^maintaining instructional materials" (GMIM), shown in the sedond column 

V , ■ of Figure 2 , 11 performance indicators are included in the instruments 

4 ' * * 

* to assess the degree to which the CMIM dimension is implemented as 

• # i prescribed by the ALlSM's design. The printout also includes "information 

*" ' - v *~ "*'#*"'" VI ' 
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on each "teacher's degree of implementation with respect to each of the 
12 , critical dimensions, as well as mean percentages of the degree of 

implementation for each grade within a particular school, fop a given 

« • 

school, for specific grade levels across an entire school district, and 
for the entire district* 

The criterion for "good 5 ' or high degree .of implementation of a 
critical dimension was set at 35%* That is, when 85% or more of the 
items in a given dimension were observed to be present, the degree of 
implementation of that pro'gram dimension was considered to be "high/ 1 
When 50% to 84% of the items, for a given dimension were- present, 
implementation o£ that program climension was considered to be "average. 11 
If less than 50% . of the items 'in a given dimension - were present^ 
implementation of that dimension was considered to be "low. 11 Using these 
criteria, Figure 2 shows, for example, that all of the classes in School 
A, Except Grade 2; achieved "higlj" implementation of the "instructing 11 * 
(INST) dimension. Graded had an, "average 11 degree of implementation 
score (79% of the items present). 

The overall degree of implementation across a Variety of schools 
for ah extended period of~ time can provide evidence ^ of the 
"implementability" of the ALEM and its critical dimensions. In 
addition, the degree of implementation of particular dimensions can be 
analyzed for individual teachers and used in estimating their training 
"needs and developing specific staff development plans,. Similarly, 
grade, school, and* site* averages can* be used to identify staff 
development needs by grade levels, schools, and particular school 
districts. Analyses of the changes in degree of implementation from one* 
assessment period to, the next can provide information to teachers about 



■ a 

-their individual implementation^ progress , as well as' information that 
can serve as the data base for evaluating the effectiveness of schools' 
implementation and staff development efforts • * * 

Adaptive staff development plans . The Data-Based Staff Development 

Program is ^ operationalized in school sites through site-specific staff 

development plans • vA comprehensive staff development plan is developed 

for each site at the beginning" of every school year. The plan is based 

on a variety of information, including degree of implementation and 

student learning progress data from the spring of the previous school 

year (for new teachers and/or new - implementation sites, , f rom the. 

m ,\ , _ 

beginning of the school year); each site's identified staff development 

^needs; -and the major categories of activities proposed to meet those 
1 needs during the year. •* 

y 

\ 

Specifically, staff development plans include* (a) a description of 
the specific training tasks/objectives for items in the degree of 
implementation measures that consistently* show scores below the 85% 
criterion level across a significant ^number of teachers (and/or for a 
...particular teacher); (b) the dates the^training is to be completed; 
■(c) the persori(s) responsible for training; (d) the type of activity to 
be conducted; (e) the expected outcomes; and (f) evidence of effective 

service as it relates to successful completion of the training. An 

/• 

excerpt from .tfte staff development plan for School District B is shown 

f 

in Figure 3. _ 

Insert Figure 3 about here J 
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Staff development plans are reviewed periodically by site personnel 
(e.g., education specialists and/or principals) to : * determine the 
appropriateness of the planned training objectives, as well as to 
monitor ^rogress^owar^-achievement--of— t4*e-objecti4«ss^ — Monthly -training — 
logs, kept by education specialists, are a major source of^ i;nfWmation 
for reviewing each site's progress 1 and updating its staff development 
olans. The logs include descriptions of activities fi such as classroom 
observations, conferences between teachers and education specialists, 



and in-service training workshops. Figure 4 shows a sample training 
log. 



Insert Figure 4 about here 



In addition to periodic reviews, during which staff development 

o 

plans for each site are updated and revised if needed, formal reviews of t 
'the plans are scheduled following each of three .data collection periods 
(generally ( scheduled in October,, February, and April). Data on degree 
of implementation and student learning progress are collected* by site 
personnel during the three specified periods and are analyzed for both* 
formative and summative evaluation purposes. 



& The Study; An Investigation of the Effects of the 
* Data-Based Staff Development Program 



During the 1980-81 school year, a pilot investigation of the 
effectiveness of the Data-Based Staff Development Program in improving 
classroom^implementation" of the, ALEM Was conducted. The study is part 
of an "ongoing program of research designed to provide information for 
the systematic 'improvement of the * ALEM and its implementation in a 

16 
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variety of school sattings. 'The netting' in which the study was 

conducted, the measures used, and the results 6f the study £re discussed 

«» 

in this' section. r . 

* ' i 

Setting 

The setting for the study consisted 'of 10 school sites, including a 

total of 156 classes (kindergarten through fourth grade). The school. 

districts are located in communities with varying ethno-cultural , 

\ . 
socioeconomic, and geographic characteristics. Included are inner-city 

N « " * 

suburban, rural, and Appalachian communities* Each of 'the sites in the 

study participates in either the National Follow Through Program (a 

i 

nation wid e co mp ensato r y educatio n program of the U.S. Department of 
Education) or a mainstreaming program for gifted and mildly handicapped 
students sponsored by the U.S. % Office of Special Education. Table 1 
provides a summary description of the participating school districts. .^ 



Insert Table 1 about here 

Measures 

" * i , 

Data 'for the study were obtained through the use <of three sets of 
measures: the degree of implementation monitoring instruments, the 
school districts' staff development plans, and the monthly training logs 
kept by the sites' education specialists. 1 

Degree of implementation instruments . The - s ix instrument s 
described earlier were administered during October, February, and April 
of the 1980-81 school year in each of the classrooms participating in 
the v study. . The instruments were used to systematically determine the 



presence or absence of the 12 critical- dimensions of the ALEM- in the 

*\ • ■ - 

classrooms. The resulting data were analyzed and reported in the format 

. illustrated in Figure 2, Of particular interest in this study were the 

changes iq the degree of implementation between data collection points. 

Staff development plans . A staff development plan was designed for 
each of the participating sites at the beginning of the 1980-81 school 
yearC As shown in Figure 3, staff ^development plans include information 
on prescribed training tasks/objectives, dates of traihing, names of 
persons responsible, type of activity to be conducted, ^nd expected - 

outcomes in each of the critical dimensions identified as requiring 

\ - , 

improved implementation. These dimensions were identified* through • 

i 

analysis of the sites' degree of implementation data for Fall, ^1980 and 
other related data, - such as students' .learning progress in the ALEM's ~ 
curriculum and the* results of standardized achievement tests. As 



mentioned previously, staff development plans are updated throughout the 
- school year according to sites' changing training needs. Information on 
changes in staff development plans was analyzed in terms of specific 



— „_ ^ _ - ^££^31 dimensions req uiring improved implementa tion and the nature of 
* - ** » * 

th& prescribed training activities. 

Monthly t raining logs. Data Ipn the actual implementation of 
training activities prescribed in the sites' staff development plans 
were obtained from the monthly" training logs prepared by education ° 
specialists • Logs * were completed for each of the classrooms 
participating in the study As shown in* Figure' 4, information is 
categorized according to (a) classroom observations (generally done by 

the education specialists) of student-teacher behaviors associated with 

/ \ ' ■ . • ' "1 

the ALEM's critical dimensions, (b) strategies suggested by education 

: ' . - \ ' ' 

eric is, ^ 
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specialists for improving the implementation of particular critical" 

> 

dimensioas, (c) expected outcomes of the suggested .training strategies; 

*' . 
and (d) findings of follow-up observations* 

* 

Results 

* " """" ... 

Information obtained from the three data sources described above. 

formed- the basic data set for the study. The data were analyzed" to^ 

investigate the relationship between staff development plans a*hd program 

implementation needs as suggested in the degree of implementation scor.es 

for individual teachers. Specifically, the data served as the basis for 

answering three related questions: "Did the staff development plans for 

each site reflect the ^individual staff's program implementation needs?"; 

"Were the sites' training activities related to the staff development 

plans?"; and "Did degree of implementation scores improve as the result 

of specific training activities?" 

>» 

4 * * * 
Consistency between staff development plans and t the identified 



program implementation needs . To determine whether the sites' staff 

' . f > t \ -\ 

development plans were consistent with their identified training needs y 

ti- 
the ctegree of implementation scores from October/- 1.980 and the overall 

\ I 

1980-81 stiff development plans developed for each of the sites were 
analyzed. The training objectives listed in the staff development plan 
for each site were compared to the critical dimensioris in which the 
site's deg ree of implementation scores fell b elow the 85% criterion 
level*. percentages of agreement between the two sets of^ data were, 

calculated. . * 

\ ■ ■ • . ■ 
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The results 



Its of the analysis are reported in Tattle 2* As shown in 



the table, the staff development plans excluded 98% of the dimensions 
with scores at or above the 85% ^criterion level (an indication that no 
special training w£s needed) 9 \ while 86%. of the dimensions with=>scores 
below the criterion level (an indication that training was needed) were 
•included in the staff development plans • In other words, .there wafc 86% 



agreement between the specific performance indicators for „yhich__the„ 
degree of implementation data suggested the need for , training and the 
training activities/objectives included in the staff development plans* 
Similarly, 98% agreement was achieved between the ^degree of 
implementation data that indicated no training was needed and the 
critical dimensions excluded from the staff development plans* The 
overall data suggest^hatr^the^sites' staff development plans were highly 
consistent with the training netfds ideh^fied^in the Fall, 1980 degree 
of « implementation data* . " — _ 

Insert, Table 2- about here 



Further investigations of the exclusion from the staff development 
plans of 14% of the critical dimensions with scores belowithe criterion 

level revealed that these dimensions were included in the plans designed 

f 

for individual teachers* Since only a few of the sites' 7 teachers yere 

involved, training in the dimension's was excluded from the overall staff 

/ ' ' 

development plans* ^ 

0 

t * 

\ ♦ 

Consistency between identifi ed staff development needs *andf training 

activities * „ % To investigate the -extent 'to which the prescribed training" 

- - — —~ . — - * * * & 

activities actually were conducted to meet the' * specific staff 
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development needs (training objectives) identified in- thB staff 

development plans, corf elation analyses were, o carried out between the 

prescribed training activities and* the training activities recorded in 

the education specialists' monthly logs. The analyses included a " 

detailed review of each ent'ry in the logs. Specifically, each entry was; 

classified by a trained observer as relating to one of the 12 critical 

dimensions of — . thel^ALEM.- tfiis ^-classification was based on' the 

\ relationship of the nature .of the training activities listed in*the logs 

to one s (or more) of the ,96 performance indicators included in the 12 

critical dimensions. The result was a lisfc-, for each oj: the 1119 

teachers on whom data were, available,, of ^the number of times he/she 

received a training-related contact in- each of the dimensions. The 

9 * 

reliability . *of _this process was calculated from the percentage of ^ 
agreement scores for two .raters. 1 iese scores consistently were abtfve 

98%. • : 

Table 3 provides a summary of the. correlations between the critical 

* * * * 

dimensions included, in the staff development plans and the number of 

times v training related to those i dimensions was listed in the education 

specialists' monthly logs. The correlations were all positive in 

x direction, and they ranged in magnitude from .05 ("traveling") to .59 

X 

("arranging space and facilities"). Significant correlations were found 
in eighKof the' 12 dimensions, and an overall significant correlation 
was 'found (r\ .37; £ < *Ql)< 



Insert Table 3 about here 
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Nature patterns ;>f changes observed as the result of the 



training * *± pcovic* information related to £he* extent to which 

training b3*«eJ '>n staff development plans was effective "in improving the 

* * » 

degree of program, implementation at the sites, changes , in the decree of 

f 

implementation data between the Qctdber; and April (Fall, 1980 .and 
Spring, 1981) data collection periods were analyzed • The results are 



reported^-ln Table 4." "Each site:' s fall and _ spring average percentage 
scores on each of the 12 critical prograp dimensions are summarized in 
the * table, along with changes in the site's 'mean percentage scores 
between fall and spring of the 1980-81 school year* While there was 
variation in the magnitude of changes in the .10 sites' degree of , 
implementation scores* between fall and spring, positive Qh&nges were 

observed in all the sitfes in-a-major-ity- o f - th e ^ c r itic a l - dimensio ns-. In-' 

V : ' < / 

-fact-^.88% of the- scores on each critical dimension across all 10 sites 

• . • * 

improved or remained stable. Analysis^of the; overall changes in the 
sites' degree of implementation scores between , fall and spring -was 
statistically significant at the .01' level. 

■ \ 
Insert Table 4 about here \ _ 



An^analysis was^also dbne of the relationship between (a) the 



_aalvsis was also 

/ 

critical' "dimensions * shown in both, the fall data and the education 



specialists' monthly logs as, not having met the criterion level, and (tf) 
the critical \ dimensions shown in the spring data as not having met the 
criterion level. The results of this analysis across the., sites ^showed 
that the mean number* of critical dimensions (across the 12 critical 
dimensions) not meeting the 85% criterion level ^n Oct&ber, 1980 was 
four. By April, 1981, the mean number of dimensions not meeting the 
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criterion level was reduced ^o_twa«,_ This — reducti on— is statis tically 



significant (j> < .Ob). 

^In order to assess the extent to which changes in^ the degree 1 of 
implementation. -for specific critical dimensions were the result of 
planned staff development activities, comparisons were made ' of the 
-changes- in —(a-)- the degree of implementation of the critical dimensions 
identified in the staff development p^arfs as ^reas in which training was 
needed and those dimensions identified in the monthly logs as areas in 



which training actually took placle, and (b) the critical dimensions 'that 
did not appear in the monthly logs. The results are reported in Table 5 
for 138 ueachers** It should be noted that although a total of 156 
classes took part in the study, some classes were morning^or afternoon 

kindergarten sessions taught by the same teacher* Thus, the total 

- \ - ' ' • \ 

number of teachers in the study was 138 rather than 156* 

Insert* Table -5 about here - . 



* Table 5 shows that while the fall^and spring degree of 
Implementation ' data' reflect' a pattern of positive changes, greater 

Ur* ' - 

increases .were found in the degree of implementation scores fov 



dimensions in \ which . training took place than in the scores; # for 
dimensions not included -.in* -the training*. Of the -1108 critical 
dimensions* in which training took place, 80% (886) showed improvement* 



On the other hand,' only 40% (219) -of the 548, critical \ dimensions for 

» * » 

which .no specific training was planned showed improvement* It also 

should be- noted that differences were foiitid between the percentage of 

critical dimensions included in. training but not showing any change, and 
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.the percentage o£ those excluded" from training and showing no change 

''(last column of . Table 5)# Scores for only 14% (155) of the critical 

>* 

dimensions in which training took place remained stable, while 52% (285) 

■» 

of the scores for critical dimensions not , included in the staff 
development plans remained stable* These results suggest that increases 
in program implementation scores occurred for critical program 

dimensions in which training, took place, compared, to little or no 

i 

improvement for critical dimensions . that needed further training but 

i . : .... 



were excluded from the training plans (and for which actual training did 
not occur) • 

\ 

-% - • / 

Summary and Discussion * 

** * 

1 

Data from the pilot c study^ provide preliminary ^ evidence of the 
feasibility and * effectiveness- of using degree of implementation 
information as a data base for* designing staff development programs that - v 
meet; the training needs of individual teachers* In addition, the data . 
provide suggestions for a future research and program refinement agenda • 

Thr^e major findings from the pilot study seem most relevant to 
*. 

increasing our understanding of, and improving current capabilities^© . _ 

provide, effective staff development systems* The first finding is that 

information derived from measures of the degree of program \ , 

implementation that are .based on the use ,of specific performance < 

indicators for assessing the presence and absence of critical program ^ 

_ ***** 
, feature s_arej>seful in identifying staff ♦development needs for improving * 



program , implementation. Second, staff development activities 'designed^ 

* # 

..on. the basis of identified, needs can be effective in improving the 
degree of implementation of specific program dimensions. d The final 
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major finding is that teachers tend to improve their program 
implementation in areas where specific staff development work is 
conducted. That^s, training does, make a differenced 

V 

Although preliminary evidence from the study seems to be quite 
supportive of the Data-Based Staff Development Program, at least two 
types of further research and development work are needed. One obvious 
line of future work is replication <pf the. present study in subsequent - 
school years, together with detailed descriptive studies of. the 
implementation *and outcomes of the program. In such studies, other 
sources *of 'efficacy information should be tapped * (e.g., teachers' , 
education specialists', and other users' assessments of the usefulness^ 
of the data-based approach), and an emphasis should 'be placed on 
identifying various alternative strategies employed by teachers^ and 
other school personnel in systematically using * the Data-Based Staff 
Development Program to maintain* and refine 'their program implementation 
Also ^documentation is ne'eded.of (a) the types of training activities 
designed and *used; * (b) the decision-making rules used to prioritize 
training needs; (c) the time required for and spent on certain types of 
training activities"; *.(d) the extent of teachers' involvement in 
designing specific training activities; and (e) the efficacy of various 
^training strategies for meeting individual staff's training needs.^ This^ 
kind rf of information is likely to contribute to the knowledge base on how 

to make staff 'development more relevant to schools' program 

■ + 
implementation, needs. . 

The second line of research needed in £fiis general topic area is 



investigations of the "generalizabl'XIEy" of the~ data-based-appraacbjtp_ 
Staff development . While it is important to provide evidence .of the 

25 
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ita-Based -Staff '.Development- Program's effectiveness in improving 

^implementation of the ALEM's. critical dimensions, use of the ALEM's 

•degree of, implementation instruments to describe > the presence and 

absence of critical dimensions in classrooms^with other programs aimed 

at providing school learning experiences that *re adaptive to student 

•differences^- should be investigated. The .basic question would be, "Do 

the program-specific performance indicators included in fl the ALEM's 

degree of - implementation measures assess a generic ,,set~ of expertise 

* . ■ \ V 
required to effectively implement any adaptive education program? 1 ' 

# ~ " ■ 

Investigations of the extent to which the ALEM's critical program 
features • are "present in classrooms that are demonstrably effective in 

providing adaptive instruction, but use different educational approaches 

o ■ • ^ 

and programs, would not only provide external validation of the ALEM's 

- * 

design, but' also could prove to be very fruitful, in the development of a 
systematic methodology for -improving the implementation of programs wi£h 
goals and designs similar to those of *the ALEM. the long-Ange 
implications of research in this area would constitute an important 
contribution to the provision of much-needed technical supports* ^to v 



schools in* their ^ efforts, to meet the ♦challenge of providing relevant,** 
ongoing staff development programs that meet the needs of individual 
teachers • ' * _ • 
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CRITICAL PROGRAM DIMENSION CODES 

ASftF ARRANGING SPACE * FACILITIES MAD 

CMIM ' CREATING ft MAINTAINING INSTRUCTIONAL MATERIALS , - PfcES 

ECRP ESTABLISHING A COMMUNICATING RULES & PROCEDURES TRAV 

MA MANAGINGlAIDES , , INST 

YE ST TESTING • # ^ WOTI 

RCRD RECORD KEEPING SP 

NUMBERS IN PARENTHESES INDICATE NUMBERS OF ITEMS (PERFORMANCE INDICATORS) 
INCLUDED IN THE DEGREE OF IMPLEMENTATION ASSESSMENT INSTRUMENTS 

* 

DISTRICT X 
APRIL, 1981 



MONITORING ft DIAGNOSING 
PRESCRIBING 
TRAVELING 
INSTRUCTING 
MOTIVATING 
STUDENT PLANNING 



School A ■ 

Grade 1 Teacher A 
- — Grade 2 "™~ TVacHer B 
Grade 3^ Teacher C 
Kindergarten Teacher 0 
Average for School 
Schoot B 

Grade 1 * Teacher E 
Teacher F 
Average 
Grade 2 Teacher G 
Teacher H 
Average 

Grade 3 Teacher ! 

Teafcher J 
Average 
Kindergarten Teacher K 
Teacher L 
Average 
~Average^for Softool 
School C 

Grade 1* Teacher M 
Grade 2 Teacher N 
. Grade 3 Teacher 0 
Kindergarten Teacher P 
r Teacher Q 

Average " 
Average for School 
Average for Site 
Grade Averages 
Grade 1 
Graded 
Grade 3 
Kindergarten 

Overall Average * 



AS&F 
(It) 



CMIM ECRP MA 
(11) (27) (3) 



TEST RCRD 
(4) (3) 



M&D 

(8) 



PRES 

(5) 



TRAV 
(2) 



INST 
(14) 



MOTI 

(5) 



SP 

0) 



100 

— 100" 
100. 
100 
100 

SI 
91 
91 

f 100 
91 
95 
91 

v 100 
95 
100 
82 

* 91 

3^93 

"100 

91; 

100 
91 
91 
91 
95 



82 

9T 

46 

73 

73 

73 
73 
73 
73 
73 
73 
73 
73 
73 
73 
73 
73 
73 



73 

73 
73 
100 
86 
78 



"93 
85 
93 
91 

100 
82 
9J 
96 
96 
96 
78 
* 96 
87 
100 
70 

*90 

85 

93 

P6 

82 

96 

89. 

90*? 



JLQ0 
100 
100 
100 
100 

100 
100 
100 
100 
100 
100 
100 
100 
100 
100 
100 
100 
100 

c 

100 
100 
100 
100 
100 
100 
100 



75 
100 

50 
100 

81 

75 
100 

88 
100 
100 
100 
100 

75" 

88 



100 
100 
100 
100 
100 

• 100 
100 
100 
100 
100 
100 
100 
100 
100 



75 "100 

75 100 

75 100 

88 ,100 



100 
100 
100 
50 
100 
75 
90 



100 
100 
100 
100 
100 
100 
100 



100 
88 
100 
100 

97 

100 
100 
100 
100 
10O 
100 
100 
100 
100 
100 

63 

81 

95 

100 
100 
100 

75 

88 

81 

93 . 



100 
100 
80 
100 

95 

100 
100 
100 
100 
100 
100 
100 
100 
100 
100 
100 
100 
100 

100 
100 
100 
100 
100 
100 
100 



100 
100 
100 
100 
100 

100 
100 
100 
100 
100 
100 
100 
100 
100 
100 
50 
75. 
94 

100 
100 
100 
50. 
100 
75 
90 



100 
79 
86 
93 
89 

100 
100 
100 
100 
100 
100 
79 
100 
89 
100 
57 
79 
92, 

100 
100 
100 
93 
100 
96 
99 



100 
100 

60 
100 

90 

100 
80 
90 
100 
100 
100. 
80 
100 
90 
100 
*80 
90 
93 

100 
100 
100 
80 
100 
90 
96 



100 

100 

100 
67 
92- 

100 
100 
100 
100 

4 1°° . 
V100 i 
67 

100 \ 

83 
100 

67 

83 

92 

67 
100 

ilbo 

67 
67 
♦67 
80 



95 


75 


90 


100 


88 


100 


100 


100 


100 


100 


95 


92 


95 


77 


94 


100 


100 


100 


'97 


100 


100 


95 


100 


100 


98 ' 


66 


89 


too 


81 


100 


100 


95 


100 


91 


* 85 « 


92 


93 


78 


88^ 


100 • 


80 


100 


85 


100 


80 


89 


92 


73 


95 


74 


90 


100 


87 


100 


95 


99 


94 


93 


93 


88 
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Figure.2. A sample computer printout of a summary of degree of implementation data. 
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Site: School Mstrfct t " 






Task Training CaJecMve 


* Date 


Person (5) 
Responsible v 

\ — 


Type of 
Activity 


Expected Outcone(s) 


Evidence * 
Effective Service 

> « « , 


"* ^ 

1. Creating end Maintaining 

1 mt rational Materials 

1,1 Cm4*t in-service workshop 
en criteria for creating 
expl oratory* activities. 


• 

March 18 


• AMf* ** — t ft Ctmtt 

project Matt 
^location Specialist 
Principal 


/.*• ' ** 
**** 

Work shoo 


* Increased javareness of 
criteria used in .con- 
structing exploratory 

'activities. 


Teachers use criteria In de- 
signing and evaluating axpl or- 
atory activities* 

\. - 


t 2 Tfifktri evaluate Materials 
■ccerdiiic to criteria. 


Htrch 23*27 


Classrooa Teachers 

\ 


Evaluation 

a 

\ 


Teachers examine explor* 
atory Materials. 


Mat.rUls «Mtf crittrl*" 

— _^ _ A.+ m^,A 1m a weal ai aIavw 

are used in expioieiory 
activities. y \ 


t.5 Tiacners ca^efor i te #lf*~- - 

4 constructed Materials 
— * according to curricular t ~~ ~~ 
area'. 


March 23*27 


Classrooa) Teachers 


> 


Materials are categorired~~ 
and ready for classrooa) , . . 

fuse* " 


-E*p1 orajorjraateria! s~are~"; 
Jabeled^ according to cur- 
rlculararea.- . 


1.4 Teachers list a«efu! 

Materials (as per criteria). 


Ongoing 


Classrooa) Teachers 


Consultation 


Teachers- list Materials 
already constructed and 
»AA nm Materials as they 

WV tlCw aaei ivi iai ? ^ ' / 

are constructed. 


Update of list. 


2. indent Manning * * 

2.1 Review perforaence indica- 
tors Included In the degree 
of lapleaetitatlon aeasures 
11 related to student planning 
In eeekly staff Meeting. 


March 11 


\ 

Education Specialist 
School fx inclpil 


t 

s 

Staff Meeting 


Teachers understand the 
rationale and need for de- 
veloping supports for stu* 
dent planning and for 
developing strategies to 
help students plan. ^ 


Teachers are able to help 
students gain increased respon- 
sibility for planning. 


2.2 Classrooa rules and pro- 
cedures are re -established 
,^„and written down, t _ 

2.5 Teachers review planning 
procedures and rules with 

'.Students. 


^ March 16 
March 18 


ClassrooM /Teachers » 
Education Specialist 

•Classrooa Teachers 


\» ^ 
Discussion and *, .. 
development of 
list 

Discussion with 
students 


tales and procedures are 
listed. 

----- « 

Teachers and students 
establish rules. 

/ 


Listing of classrooa rules 
and, procedures. 

Students-are able to 
verbalize rules. ^ r 


2,4 Students are observed and 
Interviewed hy teachers 
and education specialist 
during self* scheduling. 

* 


April 14 

• 


Classrooa Teachers 
Education Specialist 


Ohservat Ion 

y 


Description of each stu- 
dent's functioning under 
the Self-Schedule Systca. 


Students coanunlcate rulea 
and procedures to observers 
verbally and ^nonverbal ly, 

• 



I • 

Figure 5." An excerpt from the 1980-81 staff development plan for School District B. 
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LOG 

School! _J _J - "District: Grade: 

Teacher: Date: \ '. — ; Time:. 



Observed Behavior ■ 


Strategy Suggested 


Expected Outcome 


— Math skillsintroduced^without ~ 
use of concrete aids. 


* * 

Use cdncreTealcts to introduce new skills. 

* 


» or 

Concepts are introduced with 
Manipulative^. Less time is 
spent teaching a skiff. ; 


Students 'marked self-scheduling 
i « /b/cfer on own. 


* ✓ 

Only aide or teacher marks self-scheduling 
sheet. 

r 


Students ask teachers faide) 
to check their self- scheduling 
shee t when work has beejn 
completed. . / / 

/ 


Paper/pencil tasks used in math , 
*exploratories. . * 

. \ - 

/ 


* * 

Include math activities - ma//? A/ago. 


ore hapdson tasks are in- — 
eluded. 

> 

* • 

' 6 


Follow Up: , 

I 




; 


- - - ■ • \ 


F'hjurc 4. Sample monthly training log. 





Tebte 1 I 
Characteristics of Participating School Sites 
1960-81 School Year 



Characteristics 



Site 


♦ 


Title 1- 
Eligible 
Students 
In District 




Number of 




Number of ALEM Clestet «t Etch Grade Level 




Community 


ropuiaiton 


Participating 
- ocnoois 


_ If 


1 - 


1-2 2 


2-3 


1 -2-3-^3 3-4 


Follow Through Sites 
School district A 


Urban Industrial ' 
Community 


40% 


250.000 


i 

2 - 


6 » 


6 


5 




- 


.6 


School District B 


Rural Native 
American Community 


52% 


8.731 


1 


6 


6 


' 6 

1- 
1 




• 


s ' 


School District C 


Semi-rural 
Community 


20% 


'37.791, 


3 


5 


4. 


4 


r 




4 


School District D 


/; 

Rural 

Community 


22% 


7,000 


3 . 


• t 

4 


5 


6 


1 


t 


5 


School District E 


Rural Appalachian 

Communi t w 

vUl llllUJMl 


28% 


28,762 


3 


4 




3 


2 


e 


3 

1 


School District F 


Urban/Rural 
Community 


24% 


80,000 


3 


8 


6 . 


1 8 

J? 


. 1 




6 


Mainst reaming Sites 
School District G 


Suburban Working 
Class Community 


11% 


11,901 


1 


4 


1 


^ 

? 1 






1 2 


School District H 


Large SoburbanLow 
SES Community 


13% 


33,185 


J 


2 






% 


3 




School District 1 


Large Suburban 
Mixed Low to Middle 
SES Community 


5% 


33.172 


1 


2 




4 


» 






School District J 


Small-Town Suburban 
Low SES Community 


> 19% 

r 


10.250 




2 




4 








Total for 10 Sites 


* 




' c 


10 


48 ° 


28 


11 29 




3 29 6 

(156 Total Classes) 



34 35 



Table 2 ' 

Percentage of Agreement Between the Sites* Degree of Implementation 
Data and Staff Development Plans 

-Fall; 1980 ~ 7 " ~ ' 



Staff Development Plans 



Degree of Program 
Implementation 



Percentage of Critical Dimensions 
Not Included in Staff 
Development Plans 



Percentage of Critical Dimensions 
included in, Staff 
Development Plans 



Percentage of Critical 
Dimensions At jor Above 
\ the 85% Criterion Level 



98 



I 



Percentage of Critical. 
Dimensions Below the 85% 
Criterion Level \ 



14 



86 



\ 



/ 



Table 3 



* Summary o*.the Corrections Between Critical Dimemions Identified in . 
Staff Development Plant and Training Activities Listed in 'Monthly Logs 
! 1980-81 . . 

(N « 119 Teachers* 1 



Critical Dimensions 



Significance 



Arranging Space and Facilities 



.59 



<-.05-' 



Creating and Maintaining. 
Instructional Materials 



.4B 



<05 



Establishing and Communicating 
Rules and Procedures 



.45 



<05 



Managing Aides 



' \ 



.14 



N.S. 



Testing 

Record Keeping 



.23 



.33 



- I 



<05 



<05 



Monitoring and Diagnosing 



.17 



N.S. 



Prescribing! 
Traveling v 
'Instructing 
Motivating 



.29 



.05 



.13 



.57 



<05 



N.S. 



N.S. 



•' <05 



Student Planning 



.36 



-<05 



37 ( '/ 




/ 
/ 



\ Summary of the Degree of Implementation Data 
\ Average Percentage Scores 

\ K \ 1980 and Spring. 1981 



Critical Dimensions 




Creating and Main- Establishing and 
Arranging Space taming initru 
and Facilities , Mater ia1s\ 



ructiontl Communicating 
ialsY ; flutes & Procedures Managing Aides 



Testing 



Record Keeping 



Site* 



Fait Spring Change^ Fall Spring Change r^alt Spring Change Fait Spring Change Fall Spring'Change Fall Spring Chanft 



School District A 61 98 1+37) 73 71 (-2) 69 97 (+28) 100 100 (0) 100 100 (Q) 

School District B 73 94 (+21) 67 85 (+18) 82 95 (+13) 100 100 (0) 100 100 iO) 

School District C 73 96 (+23) 71 87 (+16) 70 94 (+24) 80 100 (+20) 100 100' '(OH 

School District D 83 91 (+8) 73 64 (-9) 80 91 (+11) 57 93 (-4) 95 -100 (+5) 

School District E 94 97 (+3) 72 85 (+13) 73 86 (+13) 98 98 (0) .100 100 (0) 



School District F 87 92 (+5) 

School District G 92 95 (+3) 

■ School District H 92 94 (+2) 

School Districi I 92 98> (+6) 

School District J 92 92 (0) 



79 89 (+10) 72 92 (+20) 97 98 (+1) 100 99 (-^j 

88 74 (-14) 89 90 (+1) 96 100 (+4). 91 ^87 (-4) 

71 80 (+9) 75 93 (+18) 70 100 (+30) 92 100 (+8) 

45 97 (+52) 76 94 (+18) 100 100 (0) 100 100 (0) 

74 87 (+13) 85 89* (+4) 99 99 (0) 98 100 (+2) 



67 100 (+33) 

67 100 (+33) 

67 100 (+33) 

90 100 (+10) 
94 100 ,(+6) 

100 100 (0) 

. 100 100 ,10) »* 

100 95 (-5) 

100 100 (0) 

91 56 (+5) 



Cross-Site Average 84 95 (+11) 65 82 (+11) 70 92 (+15) 94 99 (+5) 98 99 (+1) 88 99 (+11) 



'/ 



ERIC 
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* 


# 


• 




4 * " 

* * 
Table 4 (continued) 


* * * 
♦ » 


• 


• 


• • 


* 


> 

. ^ v 












Critical Dimensions 










f 








Monitor >ng an*/ 
Diagnosing 


Prescribing 


Travflinq 


Instructing 


Motivating 


Student Planning 


• * 

Overall 
Average 


• 




Sites 


Fall Spnnq Chanqe 


Fall Spring Change 


Fall Spnnq Change 


Fall Sprint) Change 


Fall Spring Change 


FaU Spring Change 


Fall Spring Change 






School District A. r 


81 '91 (+10) 


80 


100 (+20) 

0 


75 100 (+25) 

i 


75 75 .*(0) 


75 100 (+25) 


42 


58 


(+16) 


75 91 (+16) 






School District B 


83 96 (+13) 


93 


100 (+7) 


67 .100 (+33) 


74 86. (+12) 


87 *100 (+13) 


67 


78 


(+11) 


80 95 *Vj5) 


• 


• 


, School District C 


«63 93 (+30) 


92 


100 {+8} 


40 100 (+60) 


70 81 (+11) 


64 91 (+27) 


73 


96 


/ * not 

(+23) 


* 

72 95 (+23) 


* 


✓ 


/ School District D 


91 88 (-3) 


98 


100 (+2) 


65 80 (+15) 
• 


69 76 (+7) 


64 , 80 (+16) 


6G 


1 

60 


(0) 


80 85^ (+5) 




*• 


I School District E 


85 93 (48) 


94 


99 (+5) 


81 75 (-6) 


86 92 (+6) 


73 .-90. (+17) 


73 


88 


(+15) 


85 92 (+7$ 


>• 




I School-District F 


97 98 >U 


99 


97 (-2)' 


89 93 (+4) 


87 91 (+4) 


78 92 (+14) 


76 


82 


• (+6) 


88 94 (+6) 


• 

i 


. -* * 


School District G 


V 

84 95 (+11) 


100 


~ 99 (-D 


94 - 94 (0) 


97 93 (-4) 


88 93 (+5) 


80 


88 


4 

■l+Oj 


92 92 (0) 




• ] 


School District H 


♦ 

91 93 (+2) 

ft 


98 


92 (-0) 


58 95 (+37) 


. 88 97. (+9) 


81 99 (+18) 


81 


84 


(+3) 


83 94 (+11) 






School District 1 


97 93 (-4) 


95 


100 (+5) 


< 

100 100 * (0) 


90*92 (+2) 


* 

73 98 (+25) 


67 


85 


; (+18) 


86 96- (+10) 




** I 


School District J 

* - r 


86 91 (+5) 


95, 


96 (+1) 


07 QQ° f4.ll 
o/ OO 

\ ' t 


ft 9 ft? f4-R\ 


76 *88 (+12) 


76 


90 


(+14) 


'87 92* (+5) 




f 


Cross-S'tc Average 


86 93 (+7) 


94 


• 

98 (+4f 


70 93 (+17) 


82 87 (+5) 


76 93 (*17) 


70 


81 


(+11) 


83 93 (+10) 






39 


# 






















; ERJC 




\ 

V 








I 












40 * 




-A - 


- - - 






• 


i 






« - 









Table 5" 

Comparison of Patterns of Changes in Degree of Implementation 
. Between Fall, 1980 and Spring, 1981 
> . (N» 138 Teachers) 



Direction of Change 
in Degree of Implementation Score* 



Critical Dimensions 



Increase 



Decrease 



No Change 



"-Numbefof v * 
■ Critical Dimensions 
; Included in 
1 Training . * f 

* . ' > 



1108* 



886 
(80%) 



67 

(6%) 



155 
(14%) 



•Number of ' 
o Critical Dimensions 
Excluded from ■ ■ 



Training 



«548* 



.219 
(40%) 



44 

(8%) 



285 

(52%) 



r 



Note\ *x 2 = 287.8. p > .01 - 

. -"Represents the sum of the critical dimensions across all 138 teachers 



- / 

7 



41 



